nofollow

nofollow is a value that can be assigned to the rel attribute of an HTML a element to instruct some search engines that a hyperlink should not influence the link target's ranking in the search engine's index. It is intended to reduce the effectiveness of certain types of search engine spam, thereby improving the quality of search engine results and preventing spamdexing from occurring.

Contents

Concept and specification

The nofollow value was originally suggested to stop comment spam in blogs. Believing that comment spam affected the entire blogging community, in early 2005 Google’s Matt Cutts and Blogger’s Jason Shellen proposed the value to address the problem.[1][2]

The specification for nofollow is copyrighted 2005-2007 by the authors and subject to a royalty free patent policy, e.g. per the W3C Patent Policy 20040205,[3] and IETF RFC 3667 & RFC 3668. The authors intend to submit this specification to a standards body with a liberal copyright/licensing policy such as the GMPG, IETF, and/or W3C.[2]

Example

<a href="http://www.example.com/" rel="nofollow">Link text</a>

Introduction and support

Google announced in early 2005 that hyperlinks with rel="nofollow"[4] would not influence the link target's PageRank.[5] In addition, the Yahoo and Bing search engines also respect this attribute value.[6]

On June 15, 2009, Matt Cutts, a well-known software engineer of Google, announced on his blog that GoogleBot will no longer treat nofollowed links in the same way, in order to prevent webmasters from using nofollow for PageRank sculpting. As a result of this change the usage of nofollow leads to evaporation of pagerank. In order to avoid the above, SEOs developed alternative techniques that replace nofollowed tags with obfuscated JavaScript code and thus permit PageRank sculpting. Additionally several solutions have been suggested that include the usage of iframes, Flash and JavaScript.

Interpretation by the individual search engines

While all engines that use the nofollow value exclude links that use it from their ranking calculation, the details about the exact interpretation of it vary from search engine to search engine.[7][8]

rel="nofollow" Action Google Yahoo! Bing Ask.com
Uses the link for ranking No No No ?
Follows the link No Yes ? No
Indexes the "linked to" page No Yes No No
Shows the existence of the link Only for a previously indexed page Yes Yes Yes
In results pages for anchor text Only for a previously indexed page Yes Only for a previously indexed page Yes

Use by weblog software

Many weblog software packages mark reader-submitted links this way[11] by default (often with no option to disable it, except for modification of the software's code).

More sophisticated server software could spare the nofollow for links submitted by trusted users like those registered for a long time, on a whitelist, or with an acceptable karma level. Some server software adds rel="nofollow" to pages that have been recently edited but omits it from stable pages, under the theory that stable pages will have had offending links removed by human editors.

The widely used blogging platform WordPress versions 1.5 and above automatically assign the nofollow attribute to all user-submitted links (comment data, commenter URI, etc.).[12] However, there are several free plugins available that automatically remove the nofollow attribute value.[13]

Use on other websites

MediaWiki software, which powers Wikipedia, was equipped with nofollow support soon after initial announcement in 2005. The option was enabled on most Wikipedias. One of the prominent exceptions was the English Wikipedia. Initially, after a discussion, it was decided not to use rel="nofollow" in articles and to use a URL blacklist instead. In this way, English Wikipedia contributed to the scores of the pages it linked to, and expected editors to link to relevant pages.

In May 2006, a patch to MediaWiki software allowed to enable nofollow selectively in namespaces. This functionality was used on pages that are not considered to be part of the actual encyclopedia, such as discussion pages and resources for editors.[14] Following increasing spam problems and a within-Foundation request from founder Jimmy Wales, rel="nofollow" was added to article-space links in January 2007.[15][16] However, the various interwiki templates and shortcuts that link to other Wikimedia Foundation projects and many external wikis such as Wikia are not affected by this policy.

Other websites like Slashdot, with high user participation, add rel="nofollow" only for potentially misbehaving users. Potential spammers posing as users can be determined through various heuristics like age of registered account and other factors. Slashdot also uses the poster's karma as a determinant in attaching a nofollow tag to user submitted links.

Social bookmarking and photo sharing websites that use the rel="nofollow" tag for their outgoing links include YouTube and Digg.com[17] (for most links); websites that don't use the rel="nofollow" tag include Propeller.com (no longer an active website) (formerly Netscape.com), Yahoo! My Web 2.0, and Technorati Favs.[18]

Repurpose

Search engines have attempted to repurpose the nofollow attribute for something different. Google began suggesting the use of nofollow also as a machine-readable disclosure for paid links, so that these links do not get credit in search engines' results.

The growth of the link buying economy, where companies' entire business models are based on paid links that affect search engine rankings,[19] caused the debate about the use of nofollow in combination with paid links to move into the center of attention of the search engines, who started to take active steps against link buyers and sellers. This triggered a very strong response from web masters.[20]

Control internal PageRank flow

Search engine optimization professionals started using the nofollow attribute to control the flow of PageRank within a website, but Google since corrected this error, and any link with a nofollow attribute decreases the PageRank that the page can pass on. This practice is known as "PageRank sculpting". This is an entirely different use than originally intended. nofollow was designed to control the flow of PageRank from one website to another. However, some SEOs have suggested that a nofollow used for an internal link should work just like nofollow used for external links.

Several SEOs have suggested that pages such as "About Us", "Terms of Service", "Contact Us", and "Privacy Policy" pages are not important enough to earn PageRank, and so should have nofollow on internal links pointing to them. Google employee Matt Cutts has provided indirect responses on the subject, but has never publicly endorsed this point of view.[21]

The practice is controversial and has been challenged by some SEO professionals, including Shari Thurow[22] and Adam Audette.[23] Site search proponents have pointed out that visitors do search for these types of pages, so using nofollow on internal links pointing to them may make it difficult or impossible for visitors to find these pages in site searches powered by major search engines.

Although proponents of use of nofollow on internal links have cited an inappropriate attribution to Matt Cutts[24] (see Matt's clarifying comment, rebutting the attributed statement)[25] as support for using the technique, Cutts himself never actually endorsed the idea. Several Google employees (including Matt Cutts) have urged Webmasters not to focus on manipulating internal PageRank. Google employee Adam Lasnik[26] has advised webmasters that there are better ways (e.g. click hierarchy) than nofollow to "sculpt a bit of PageRank", but that it is available and "we're not going to frown upon it".

No reliable data has been published on the effectiveness or potential harm that use of nofollow on internal links may provide. Unsubstantiated claims have been challenged throughout the debate and some early proponents of the idea have subsequently cautioned people not to view the use of nofollow on internal links as a silver bullet or quick-success solution.

More general consensus seems to favor the use of nofollow on internal links pointing to user-controlled pages which may be subjected to spam link practices, including user profile pages, user comments, forum signatures and posts, calendar entries, etc.

YouTube, a Google company, uses nofollow on a number of internal 'help' and 'share' links.[27]

Criticism

Employment of the nofollow attribute by Wikipedia on all external links has been criticized for not passing the deserved rank to referenced pages which are the original source of each Wikipedia article's content. This was done to combat spamdexing on Wikipedia pages, which are an otherwise tempting target for spammers as Wikipedia is a very high ranking site on most search engines. It's argued that the referencing Wikipedia article may show in search results before its own sources; this may be seen as unfair and discourage contributions.[28][29]

Use of nofollow where comments or other user content is posted (e.g. Wikipedia) not only depreciates the links of spammers but also of users that might be constructively contributing to a discussion, and preventing such legitimate links from influencing the page ranking of the websites they target.[30]

See also

Blocking and excluding content from search engines

References

  1. ^ "The nofollow Attribute and SEO". Published-Articles.com. May 22, 2009. http://www.published-articles.com/Art/18844/136/The-nofollow-Attribute-and-SEO.html. Retrieved September 8, 2009. 
  2. ^ a b rel="nofollow" Specification, Microformats.org, retrieved June 17, 2007
  3. ^ W3C Patent Policy 20040205,W3.ORG
  4. ^ W3C (December 24, 1999), HTML 4.01 Specification, W3C.org, retrieved May 29, 2007
  5. ^ Google (January 18, 2006), Preventing comment spam, Official Google Blog, retrieved on May 29, 2007
  6. ^ Microsoft (June 3, 2008), Bing.com, "Bing Community", retrieved on June 11, 2009
  7. ^ Loren Baker (April 29, 2007),How Google, Yahoo & Ask.com Treat the No Follow Link Attribute, Search Engine Journal, retrieved May 29, 2007
  8. ^ a b Michael Duz (December 2, 2006), rel=”nofollow” Google, Yahoo and MSN, SEO Blog, retrieved May 29, 2007
  9. ^ Rel Nofollow Test from August 2007
  10. ^ http://about.ask.com/en/docs/about/webmasters.shtml#10
  11. ^ Google Blog (January 18, 2005), [1], The Official Google Blog, retrieved September 28, 2010
  12. ^ Codex Documentation, Nofollow, Wordpress.org Documentation, retrieved May 29, 2007
  13. ^ WordPress Plugins, Plugins tagged as Nofollow, WordPress Extensions, retrieved March 10, 2008
  14. ^ Wikipedia (May 29, 2006), Wikipedia Signpost/2006-05-29/Technology report, Wikipedia.org, retrieved May 29, 2007
  15. ^ Brion Vibber (January 20, 2007), Nofollow back on URL links on en.wikipedia.org articles for now, Wikimedia List WikiEN-l, retrieved May 29, 2007
  16. ^ Wikipedia:Wikipedia Signpost/2007-01-22/Nofollow
  17. ^ John Quinn (September 2, 2009), Recent Changes to NOFOLLOW on External Links, Digg the Blog, retrieved on September 3, 2009
  18. ^ Loren Baker (November 15, 2007), Social Bookmarking Sites Which Don’t Use NoFollow Bookmarks and Search Engines, Search Engine Journal, retrieved on December 16, 2007
  19. ^ Philipp Lenssen (April 19, 2007), The Paid Links Economy,Google Blogoscoped, retrieved June 17, 2007
  20. ^ Carsten Cumbrowski (May 14th, 2007), Matt Cutts on Paid Links Discussion - Q&A, SearchEngineJournal.com, retrieved June 17, 2007
  21. ^ October 8, 2007, Eric Enge Interviews Google's Matt Cutts, Stone Temple Consulting, retrieved on January 20, 2008.
  22. ^ March 6, 2008, You'd be wise to "nofollow" this dubious advice, Search Engine Land.
  23. ^ June 3, 2008 8 Arguments Against Sculpting PageRank With Nofollow, Audette Media.
  24. ^ August 29, 2007 Matt Cutts on Nofollow, Links-Per-Page and the Value of Directories, SEomoz.
  25. ^ August 29, 2007 Seomoz.org, SEOmoz comment by Matt Cutts.
  26. ^ February 20, 2008 Interview with Adam Lasnik of Google
  27. ^ Nofollow Reciprocity
  28. ^ nofollow criticism at blogoscoped.com
  29. ^ nofollow criticism at www.marketingpilgrim.com
  30. ^ Official Google Blog: Preventing comment spam http://googleblog.blogspot.com/2005/01/preventing-comment-spam.html